Learning to Act Properly: Predicting and Explaining Affordances from Images
نویسندگان
چکیده
We address the problem of affordance reasoning in diverse scenes that appear in the real world. Affordances relate the agent’s actions to their effects when taken on the surrounding objects. In our work, we take the egocentric view of the scene, and aim to reason about action-object affordances that respect both the physical world as well as the social norms imposed by the society. We also aim to teach artificial agents why some actions should not be taken in certain situations, and what would likely happen if these actions would be taken. We collect a new dataset that builds upon ADE20k [32], referred to as ADE-Affordance, which contains annotations enabling such rich visual reasoning. We propose a model that exploits Graph Neural Networks to propagate contextual information from the scene in order to perform detailed affordance reasoning about each object. Our model is showcased through various ablation studies, pointing to successes and challenges in this complex task.
منابع مشابه
Affordances and limitations of technology: Voices from EFL teachers and learners
With the developments of new technologies appearing very quickly, the attention has been focused more on technology than learning. English centers and institutes have mostly been busy accommodating new programs and technologies and hence have not spent enough time to evaluate the CALL programs and technologies employed to find their affordances and limitations. The present study was an attempt ...
متن کاملIranian EFL Learners' Perception of the Efficacy of Activity Theory-based Reading Comprehension
Any language classroom is a distinctive learning context offering numerous affordances that might be perceived effectively, remain unnoticed, or even act as constraints. Therefore, exploring students' perception toward a particular method of instruction is crucial since it may produce a reliable piece of evidence for teachers to confirm or refute the effectiveness of the intended instructional ...
متن کاملA walk on the WILD side: how wireless handhelds may change CSCL
Designs for CSCL applications usually presume a desktop/laptop computer. Yet future classrooms are likely to be organized around Wireless Internet Learning Devices (WILD) that resemble graphing calculators or Palm handhelds, connected by short-range wireless networking. WILD learning will have physical affordances that are different from today’s computer lab, and different from classrooms with ...
متن کاملExplaining the characteristics of peer-to-peer learning: A qualitative study
Explaining the characteristics of peer-to-peer learning: A qualitative study Introduction: Learning through peers is an educational method. Explaining the characteristics of learning with the help of peers has not been done in a study, so the purpose of this study was to explain the characteristics of learning with the help of peers. Materials and Methods: This qualitative study was perfo...
متن کاملAffordances and Landscapes: Overcoming the Nature–Culture Dichotomy through Niche Construction Theory
In this paper we reject the nature-culture dichotomy by means of the idea of affordance or possibility for action, which has important implications for landscape theory. Our hypothesis is that, just as the idea of affordance can serve to overcome the subjective-objective dichotomy, the ideas of landscape and ecological niche, properly defined, would allow us to also transcend the nature-culture...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره abs/1712.07576 شماره
صفحات -
تاریخ انتشار 2017